RENT—Repeated Elastic Net Technique for Feature Selection
نویسندگان
چکیده
Feature selection is an essential step in data science pipelines to reduce the complexity associated with large datasets. While much research on this topic focuses optimizing predictive performance, few studies investigate stability context of feature process. In study, we present Repeated Elastic Net Technique (RENT) for Selection. RENT uses ensemble generalized linear models elastic net regularization, each trained distinct subsets training data. The based three criteria evaluating weight distributions features across all elementary models. This fact leads high that improve robustness final model. Furthermore, unlike established selectors, provides valuable information model interpretation concerning identification objects are difficult predict during training. our experiments, benchmark against six selectors eight multivariate datasets binary classification and regression. experimental comparison, shows a well-balanced trade-off between performance stability. Finally, underline additional interpretational value exploratory post-hoc analysis healthcare dataset.
منابع مشابه
A feature selection technique for classificatory analysis
Patterns summarizing mutual associations between class decisions and attribute values in a pre-classified database, provide insight into the significance of attributes and also useful classificatory knowledge. In this paper we have proposed a conditional probability based, efficient method to extract the significant attributes from a database. Reducing the feature set during pre-processing enha...
متن کاملA New Framework for Distributed Multivariate Feature Selection
Feature selection is considered as an important issue in classification domain. Selecting a good feature through maximum relevance criterion to class label and minimum redundancy among features affect improving the classification accuracy. However, most current feature selection algorithms just work with the centralized methods. In this paper, we suggest a distributed version of the mRMR featu...
متن کاملRegularization and variable selection via the elastic net
We propose the elastic net, a new regularization and variable selection method. Real world data and a simulation study show that the elastic net often outperforms the lasso, while enjoying a similar sparsity of representation. In addition, the elastic net encourages a grouping effect, where strongly correlated predictors tend to be in or out of the model together.The elastic net is particularly...
متن کاملModel Selection in Undirected Graphical Models with the Elastic Net
Structure learning in random fields has attracted considerable attention due to its difficulty and importance in areas such as remote sensing, computational biology, natural language processing, protein networks, and social network analysis. We consider the problem of estimating the probabilistic graph structure associated with a Gaussian Markov Random Field (GMRF), the Ising model and the Pott...
متن کاملAdaptive Elastic Net: An Improvement of Elastic Net
Lasso proved to be an extremely successful technique for simultaneous estimation and variable selection. However lasso has two major drawbacks. First, it does not capture any grouping effect and secondly in some situations lasso solutions are inconsistent. To overcome inconsistency recently adaptive lasso was proposed where adaptive weights are used for penalizing different coefficients. Adapti...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2021
ISSN: ['2169-3536']
DOI: https://doi.org/10.1109/access.2021.3126429